Critical behavior and correlations on scale-free small-world networks. 

Application to network design 
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We analyze critical phenomena on networks generated as the union of hidden variables models 
(networks with any desired degree sequence) with arbitrary graphs. The resulting networks are 
general small-worlds similar to those a la Watts and Strogatz but with a heterogeneous degree 
distribution. We prove that the critical behavior (thermal or percolative) remains completely un- 
changed by the presence of finite loops (or finite clustering). Then, we show that, in large but finite 
networks, correlations of two given spins may be strong, i.e., approximately power law like, at any 
temperature. Quite interestingly, if 7 is the exponent for the power law distribution of the vertex 
degree, for 7 < 3 and with or without short-range couplings, such strong correlations persist even 
in the thermodynamic limit, contradicting the common opinion that in mean-field models correla- 
tions always disappear in this limit. Finally, we provide the optimal choice of rewiring under which 
percolation phenomena in the rewired network are best performed; a natural criterion to reach best 
communication features, at least in non congested regimes. 



PACS numbers: 05.50.+q, 64.60.aq, 64.60.F-, 64.60.ah 

I. INTRODUCTION 

In the last decade, it has been recognized that at the 
base of many complex systems, as diverse as those ob- 
served in nature, in technological, and in social sciences, 
there is an ubiquitous presence of networks having certain 
universal topological features upon which the function- 
ality of the system largely depends on Essentially, 
there are two basic topological features in these complex 
networks: scale-free and small-world. The former refers 
to the fact that the distribution of the links among the 
nodes is strongly heterogeneous, in particular many net- 
works have a power law distribution for the vertex de- 
gree, V(k) ~ fc~ 7 ; the latter refers to the fact that two 
randomly chosen nodes are at distance which, for 7 > 3, 
scales with the system size N as slowly as \og(N)/ log(6), 
b being the mean branching of the network while, for 
7 < 3 (where b diverges), the average distance scales 
as log(log(AQ) or even slower and the network is called 
ultra-small [2j. Network models have then been pro- 
fusely studied over the years and many fundamental re- 
sults are by now well established and widespread [3, 0] . 
The main assumption under these studies has been the 
tree-like hypothesis thanks to which the generatingfunc- 
tion technique and the Bethe-Peierls (BP) method @ can 
be applied to get exact solutions for the percolative and 
thermal (at least in the ferromagnetic case) properties as 
well as the communication features of the system. How- 
ever, the tree-like assumption is almost never satisfied in 
real-world networks. For example, networks of friends, 
networks of neurons, the WWW, and the Internet, are 
just a few examples in which the average clustering co- 
efficient C 0, H[ is finite. More precisely, whereas net- 
works having a hierarchical structure share a k degree- 
dependent clustering coefficient of the form C(k) ~ k~ a , 
with a ~ 1, so that the most connected (and most impor- 
tant) nodes are not clustered, there are other networks 



having C(k) ~ 0(1) for almost any k and for which clus- 
tering is important for all nodes. The former class in- 
cludes e.g. some social networks, language networks, the 
WWW, and the Internet at the autonomous system level, 
whereas the latter class includes the Internet at the router 
level, the power grid, but also the brain. As discussed in 
@ , the reason for this difference is related to the fact that 
in the second class wiring is expensive (economically or 
biologically) and the network, rather than hierarchically 
organized, is geographically organized. Finally, we recall 
that even in pure scale-free networks characterized by an 
exponent 7 < 3, the tree-like assumption is not true; such 
networks in fact contain many large cliques Q- 

In the last few years there have been important pro- 
gresses for the modeling of networks with loops [g-UJj, 
however, such progresses were essentially confined to the 
cases in which the random graph can be seen as a tree- 
like hypergraph, or with a weak transitivity (i.e., with a 
small overlap between clusters). It is then of fundamen- 
tal importance to understand, in general, what is the role 
of the loops in complex networks from the point of view 
of collective behavior. In the presence of loops how do 
the critical surface and the correlation functions change? 
Are the analytical results accumulated over ten years of 
research in complex networks robust with respect to the 
presence of loops? And if yes, to what extent? We point 
out that the crucial question concerns the loops of finite 
length. In fact, in classical random graphs (7 = 00) and 
in complex networks (2 < 7 < 00) there are no finite 
loops (at least for 7 > 3; for a detailed discussion of the 
case 7 < 3 see next Section) since the length of the loops 
scales as log(iV) and, as a consequence, one can say that 
the tree-like approximation in these models becomes ex- 
act for N — > 00. But in networks in which there are loops 
of finite length (for any TV), due to the fact that the cor- 
relation length in all these models remains finite, we are 
not allowed to neglect the short-loops neither near the 
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critical point and, as a consequence, the (exact) solution 
to these issues is non trivial. 

In this paper we address the above questions via the 
introduction of heterogeneous small-world networks, a 
natural generalization of the "classical" small- world net- 
works [13] which were introduced as intermediate systems 
lying between loopy-like (e.g. finite-dimensional lattices) 
and tree-like networks. In the classical (7 = 00) small- 
world networks we have a homogeneous distribution of 
links among the sites, but also a finite clustering coeffi- 
cient, so that tree- like based techniques as the BP cannot 
be used to solve, e.g., an Ising model defined on them. By 
using a completely different approach it is however possi- 
ble to solve exactly the homogeneous small-world models 
at least in the paramagnetic phase (P) getting their exact 
critical surface and behavior If Jo is the coupling 

associated to a given graph (£07 To)* which in particular 
may have short-range links and short loops of any kind, 
and J is the coupling associated to a number Nc/2 of ad- 
ditional uniformly spread long-range links (so that they 
alone would form a classical random graph [H||), then, 
for any c > 0, the mean-field equation for these models 
is given by 

def 

rn — mo(j3Jo; ctm + j3h), t = tanh(/3J), (1) 

where mo(/3 Jo; /3h) is defined as the average magnetiza- 
tion of the model in the absence of the long-range connec- 
tions, with a short-range coupling Jo and in the presence 
of a generic external field h at temperature T = 1//3. 
Eq. is a natural generalization of the celebrated Curie- 
Weiss mean-field equation m = tanh(/3Jm + /3/i), which 
is valid for Jo = and c = N. It is easy to check that, 
however, for any Jo > 0, the critical behavior of Eq. ([1]) is 
classical, regardless of the local topology and clustering 
coefficient of the network (see also [lj| ). 

In this paper we face the natural extension of Eq. ([T]) 
towards a large class of heterogeneous small-world net- 
works generated by using hidden variables (l7l - l20j , which 
have the little inconvenient that the resulting network 
has some small degree-degree correlation [2l[, but also 
the great advantage that the model is analytically solv- 
able even in the presence of loops (at least within our 
effective field theory). After deriving the equation for 
the order parameter and the critical surface (thermal or 
bond-percolative), we analyze the connected correlation 
functions in general and we show that in these models, 
even for Jo = 0, there are finite size corrections as strong 
as 1/N 5 , with S = (^-2)/(-y-l) for 7 > 3, and S = for 
7 < 3, contradicting the common opinion that in mean 
field models the connected correlation functions always 
disappear in the thermodynamic limit. Then we prove 
that the critical behavior (thermal or bond-percolative) 
on these networks is never affected by the presence of a 
local non tree-like structure, provided that the connectiv- 
ity associated to such loopy structures is non heteroge- 
neous. This latter result has been already presented and 
discussed in a Letter [22j but limiting the proof to an in- 
finitesimal coupling Jq, while postponing to the present 



paper the general proof as well as the derivation of the 
mean-field equation. Nicely, meanwhile in (23|, we find 
that a similar robustness theorem has been proved for 
both static and growing networks embedded in a metric 
space when 7 < 3. 

In tables Q] and [XT] we summarize the state of the art 
reached about the analytical behavior of the Ising model 
built on classical and complex random graphs. We stress 
that we mention only the cases and the models where 
exact analytical calculations have been possible without 
any pretension to be exhaustive (in particular we do not 
mention here the hierarchical models (random or not), 
where some exact analytical results are also possible). 

Finally, as an application, given the desired degree se- 
quence and the graph (Co, To), we find that the equation 
for the critical surface leads to an optimization problem 
consisting in finding the rewiring of the additional links 
that provides the minimal percolating point; a criterion 
which amounts to finding the rewiring that provides the 
best communication performance at the minimal cost in 
the absence of congestion. This optimization problem 
in general is an NP-hard problem, however, we provide 
heuristic solutions whose effectiveness depends on how 
much the network is structured in communities (if any), 
and we show that the use of the formula for the critical 
surface is always exponentially (in N) convenient with 
respect to a direct inspection of the network, even in 
the worst case scenario in which there is no community 
structure at all. 



II. RANDOM ISING MODELS BUILT ON 
HETEROGENEOUS SMALL- WORLD 
NETWORKS 

A. The model 

The family of models we shall consider are built as 
follows. Let (£oiTo) be any graph, Co and To being 
the set of vertices i = 1, . . . , N and links (i, j), i < j, 
respectively. Let us consider the Ising model defined on 
the graph (Co, To) with a fixed coupling Jo and in the 
presence of an arbitrary external field {hi} 

Ho = - Jo CiO-j - y^hicrj. (2) 

(i,j)er i 

We will call this the pure model. Let us now consider 
the model obtained by removing randomly some links of 
the graph (Co,To) and by adding new links as follows. 
Let us indicate with cq-jj = 0, 1 the adjacency matrix 
of the new graph in which some links of To have been 
removed. Given an ensemble C of random graphs c, c G 
C, whose links are determined by the adjacency matrix 
elements Cjj = 0,1, we define our heterogeneous small- 
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Ising on the "Classical Random Graph" Ref. [15] (y. 1959) | m | x |Eq. for tc = tanh(/3 c J) 


P(fc) Poissonian (No Finite Loops; shortest loops scale as (^)(log(iV))) 


OCT 1 ' 2 


OC T ^ 


Ct c = 1 


Ising on the "Configuration Network" Refs. [24] (y. 2002) 


m 


X 


Eq. for t c = tanh(/3 c J) 


7 > 5, (k 4 } p < co (shortest loops scale as 0(log(A))) 


OCT 1 / 2 


-1 

OC T 


. (k) p 


7 = 5, (fe ) p = oo, (fc ) p < co (shortest loops scale as 0(log(iV))) 


1/1 —1 

oc 1/lnr 


3 < 7 < 5, (fc 4 ) p = co, (k 2 ) p < co (shortest loops scale as 0(log(iV))) 


1 1 1 -v — TT 

OC T i/t7 *> 


7 = 3, (k 2 ) p — co (Finite Loops) 


OC e - 2T /( fc >P 




/3c ^0 


2 < 7 < 3, (k 2 ) p = co (Finite Loops) 


oc T- 1 ' 1 - 3 -"" 


oc T _I 


loing on Liie OLaLic iNeLwoiJv iniciLitii vaiiauiebi xvei. ozi ly. zuuj I 


TTl 


X 




7 > 5, (k 4 ) p < co (shortest loops scale as 0(log(iV))) 


(XT 1 ' 2 


OC T _1 


ct c NJ2 lP 2 = l 


7 = 5, (fc 4 ) P = co, {k z ) p < co (shortest loops scale as 0(log(7V))) 


oc l/lnr" 1 


3 < 7 < 5, (fc 4 ) p = co, (k 2 ) p < co (shortest loops scale as 0(log(A))) 


0C-V17-3J 


7 = 3, {k )p = co (Finite Loops) 


oc e-^VWp 




/3 C ^ 


2 < 7 < 3, (k 2 ) p = co (Finite Loops) 


kT -VI»-7) 


ocT" 1 




Ising on the "Classical SW Networks" Refs. [14, 16] (y. 2003,08) | rh | x |Eq. for t c = tanh(/3 c J) 


P(fc) Poissonian + additional arbitrary links (Loops of any length) 




oc r 1 


efcxo (/3 c Jo;0) = 1 


Ising on the "Heterogeneous SW N." Ref. [22] (y. 2010) and Present Work 


m 


X 


Eq. for t c = tannic J) 


7 > 5, (fc 4 ) P < co (Arbitrary Loops of any length) 


OCT 1 ' 2 


OC T 


x V.., Xo-,i,jPiPj = 1 


7 = 5, (fc 4 ) P = co, (k z }p < co (Arbitrary Loops of any length) 


oc 1/lnr" 1 


3 < 7 < 5, (fc 4 ) p = co, (k 2 ) p < co (Arbitrary Loops of any length) 


0CT Vt7-3j 


7 = 3, (k ) p — co (Arbitrary Loops of any length) 


oc e - 2 ' J '/Wp 




/3 C ^0 


2 < 7 < 3, (k 2 ) p — co (Arbitrary Loops of any length) 




ocT" 1 




Ising on "Static and Growing Spatial Networks" Ref. [23] (y. 2011) ] m \ X |Eq. for t c = tanh(/3 c J) 


Self Similarity 2 < 7 < 3, {k 2 } p = 00 (Loops in a Metric Space) 


kT -i/1»-7) 


ocT" 1 


/3 C ^ 



TABLE I: Critical behavior of the unweighted magnetization m = ~}2i i a i) /N ( T = 1 — T/T c ), the susceptibility an d 
the equation for the critical temperature of the Ising model built on several Network Models: the Classical Random Graph; 
the Configuration Model (i.e., the maximally random graph under the constraint that the degree distribution is a given one, 
P(k) ~ k '); the Static Model (a Hidden Variables Model with weights pi oc , where fi G [0, 1) is such that P(k) ~ fc~ 7 ); 
the Classical Small World Network built by overlapping the Classical Random Graph with additional links associated to an 
arbitrary graph (£0, To); the Heterogeneous Small World Networks ([22| (Jo infinitesimal) and present work (Jo arbitrary)) built 
by overlapping Hidden Variables Models with additional links associated to an arbitrary graph (£o,To); the Spatial Network 
Model for 7 < 3 (where self-similarity applies). The data in parenthesis stands for the year of publication. We use the notation 
c = (fc) p . 



world model, through the following Hamiltonian 

0'.j)er i 

^ c,,./, , n, a,. (3) 

i<j 

The variables Cij specify whether a "long-range" link be- 
tween the sites i and j is present (cij = 1) or absent 
(ci.j = 0), whereas the variables co-i.j specify whether 
a link G To has been removed (co ; j,j = 0) or not 

( c o-,i,j — !)■ The Jij's are the random couplings of the 
given link and similarly for the Jq-^j's for the links 
of To . All the above random variables are assumed to be 
independent. For the Jo-i,j's and the Jij's we will not 
assume any particular distribution, while for the Co-ij's 
and the Cj^'s we assume respectively the following prob- 



abilities 

Po(.CO;i,j) = (1 -p)<Wi,l + P S c 0]t:j ,0, (4) 

Pij{cij) = f (Pi,Pj) <*c„,i + (1 - / (Pi,Pj))S Ctj ,o, (5) 

where p £ [0, 1], and the {pi} are a set of hidden variables 
[17H20l ] |43| each proportional to the average degrees {ki\ 
of the graph c of the nodes i = 1, . . . , N (i.e., the degrees 
in the absence of the graph (C , T j). Usually the hidden 
variables depend on one (or more) continuous parameters 
fi G X, and on N . Given the mean degree c > (so that 
in average there are in total cN/2 bonds) of the graph 
c, we will assume that for a continuous subset J C T, 
asymptotically in N we can write 

f{Pi,Pj) = c N PiPj, (6) 
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Ising on the "Configuration Network" Ref. [25] (y. 2005) 


Correlations \i of two spins at distance I; TV — > oo 


'v """> R / Ic^ \ <■"" rv~i ^Ipti cr+ Vi nf qVi n~ri~pc;+~ 1 ririT^c; cpn 1p n q /"") (\ no 1 f 7V^ ^ 1 


^ f> (f — fonhl'fl 


7 = 5, (k 4 ) p = oo, (fc 2 ) P < oo (shortest loops scale as 0(log(TV))) 




3 < 7 < 5, (fc 4 ) P = oo, (fc 2 ) P < oo (shortest loops scale as 0(log(TV))) 


x^t 1 


7 = 3, {k 2 ) p — oo (Finite Loops) 


Xi ? 


2 < 7 < 3, {k z ) p = oo (Finite Loops) 


X* ? 




Ising on the "Classical SW Networks" Refs. [14] (y. 2008) 


Correlations Xij of two given spins £ and j; TV finite 


P(k) Poissonian + additional arbitrary links (Arbitrary Loops) 


^-XO;^ + o(^L X °4o) 




Ising on the "Heterogeneous SW N." (Present Work) 


Correlations of two given spins i and j; TV finite 


7 > 3, (fc 4 ) p < oo (Arbitrary Loops of any length) 


v- -f (« i (ii)-V(-r-i) \ 
X»j X0;t,j -t- C ^ tc i_ t /t c jv(-f-3)/(7-i) y 


3 > 7 > 2, (k 4 ) p = oo (Arbitrary Loops of any length) 


x«=xo i «+o((«r i ^- i >) 



TABLE II: Connected Correlation functions \i (connected correlation of two randomly chosen spins at given distance I) and 
Xij (average connected correlation of two given spins i and j, see Sec. IIC) of the Ising model built on: the Configuration 
Model; the Classical Small World Network built by overlapping the Classical Random Graph with additional links associated 
to an arbitrary graph (£q,Tq) (xo;i,j stands for the connected correlation function associated to (Co, To)); the Heterogeneous 
Small World Networks (present work) built by overlapping Hidden Variables Models with (Co, Fq). In the Heterogeneous Small 
World Networks the formula for Xij is valid when the underlying network (£o,Fo) has dimension do < 1. For the general case 
the dependence on i and j is more complicated (see Eq. I|75|)L but the dependence on TV is the same. For what concerns the 
configuration network model, for 7 < 3, in Ref. [25| it is speculated that xi ~ for I not too small, while for / ~ O(l) one 
has Xi ~ ^'i a result which is not in contradiction with our achievement (see Sec. IIC). However, in Ref. 25] x_i was obtained 
directly by using the tree-like assumption which, for 7 < 3, is wrong even in the configuration model (in fact the formulas of 
Ref. [25| give xi = for any I > 2, which is clearly not exact). See Ref. Q and discussion [44]. Apart from technical details, the 
main point we stress is that in previous works was not possible to see that: i) finite size effects are always strong in scale-free 
networks; it) for 7 > 3 they decay as slowly as 0(l/TV' 7-3 ' ) ' /( ' 7-1 '); Hi) finite size effects persist even in the thermodynamic 
limit when 7 < 3 and, as a consequence, correlations of two given spins can be strong (power law like) when 7 < 3. 



where 

def sr~^ h 

For the validity of the results we present in the next Sec- 
tion we require the number of links (i, j) for which Eq. ([5]) 
is not true, to be less than 0(N a ), as long as a < 1. We 
will prove in fact that, in the thermodynamic limit, the 
free energy of the model (see below) is not affected by the 
presence of the 0(TV a ) links for which Eq. © is not true 
if a < 1. As a probability, Eq. © for f(pi,pj) will be 
manifestly violated in I \ J whenever cNpiPj > 1 . Note 
that, if Pi 7^ for any given TV (a requirement which is 
true for any graph in which there are not isolated nodes) , 
for TV — > 00 the terms cNpiPj tend either to or to 00, 
therefore, the number of links (i,j) for which Eq. ([6]) is 
not true for TV large approaches 

/Vat = f Y. OicNpw-l), (8) 

i<j 

where 0(x) = or 1 if x < or x > 0, respectively. 
In Appendix A we show that, if in the ensemble C the 
probability p(k) to have a vertex with degree k scales, for 
k large, as a power law p(k) ~ fc -7 , then: 

jy-2-7 1-7 

Mv< 2( ' log(TV), (9) 



so that the requirement Nn = 0(N a ) with a < 1 is 
equivalent to have 7 > 2, and, for TV large but finite, 
the error we make per spin in neglecting these 0(TV Q ) 
contributions is CKTV 1 " 7 log(TV)) for 7 > 2 0]. As an 
example of a scale-free model we can consider the choice 

f(p i ,p j ) = l-e- cN ^ (10) 

where fi £ [0,1). Equations (ITUl)- pT|) define the static 
model introduced in \Vj\ . Note that the so called 
fermionic constraint that avoids to have multiple bonds, 
is automatically satisfied by Eq. ([5]) . As has been shown, 
this constraint leads to some weak dis-assortative degree- 
degree correlations for \i > 1/2 [21]. In the thermody- 
namic limit TV — !• 00, for p e (0, 1), Eqs. pi? ]) -([TT ]) lead to 
a number of long range connections per site distributed 
according to a power law with mean c and exponent 7 
given by 

7 = 1 + -, (12) 
P 

so that 7 G (2,oo). For p G (0,1/2) (7 > 3) Eq. (JTUD 
takes the simpler form ^ while for /i G [1/2, 1) (2 < 7 < 
3) Eq. (fTU)) can be written as Eq. © only when i and 
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j are sufficiently distant, ij 3> iV 2 1 /' t , while for lower 
distances, ij -C N 2 ^ 1 ^ 1 , we have "Pij{ c ij = 1) — 1. 

The free energy F and the averages (O) 1 , with Z = 1,2, 
are defined in the usual (quenched) way as (J3 = 1/T) 

_p F dg J2P(c 0l c) J dV(J ,J)log(Z C(uCtJ ) (13) 



and 



(OY= f Y,P(c a ,c) f dV(J ,J)(O) l C0M , Z = l,gL4) 

where Z Co ^ c ^j Qy j is the partition function of the quenched 
system 



Zco,c,J a ,J - ^ e 
{^} 



-/3i?c ,c,J ,j({ CT4 }) 



(15) 



(C) COjCj j 0i j the Boltzmann-average of the quenched sys- 
tem ((C) depends on the given realization of J , J , {cq} 
and c: (O) = (O) C0iC] j 0! j; for shortness we later will 
omit to write these dependencies) 

{0) C(M d = } , (16) 

and dV (Jo, J) and P{c , c) are product measures given 
in terms of arbitrary measures (all normalized to 1) 
for the short- and long-range couplings d/J,o(Jo-,i,j) > 0, 
d/j(Jij) > 0, and in terms of the introduced link proba- 
bilities (Eqs. ((H) and (JSJ)) p (ci,j) > 0, and Pij{cij) > 0: 

dv(j ,j)= f n dviJij) n dfi (Jo-,ij) , (17) 

(i,j),i<j (»j)er 

P(c ,c) rf = J| Pij(ci,j) Yl Po(co-,i,j)- (18) 

(i,j),i<3 («.i)er 



B. A note on small- world networks a la Watts and 
Strogatz 

The class of our small- world scale-free models given by 
Eqs. ©-© is very general. Note in particular that the 
graph (yCo,ro) is completely arbitrary and can contain 
closed paths of any length. We stress that the resulting 
network, union of the graph (£ ,r ) in which each link 
is removed with a probability p, with the scale-free ran- 
dom graph c, can be seen as a scale-free gran canonical 
generalization of the original small- world graph of Watts 
and Strogatz [l3[ , though we here do not perform a true 
rewiring. Since we let the probability p £ [0, 1] and the 
mean c € (0, oo) arbitrary, our way to build small-world 
networks is more general even for the non scale-free case 
fj, = (7 = 00). However, we can always restrict our 
class of small-world networks to the ones having a to- 
tal average connectivity which does not change with p 



by choosing c such that the total number of links of the 
graph c is equal to the total number of removed links 
of (£o,ro). Up to corrections 0(1/VN) we can accom- 
plish this for any sample by simply taking c = cqp, where 
Co is the average connectivity of (Cq,^o)- We anticipate 
however that the critical behavior of these models is not 
affected by any particular choice of p and c, the only con- 
dition being c > 0. In fact, as we will see soon in Sec. 
Ill, the sole role of the parameter p is to give a renor- 
malized effective coupling Jq(j>) to be used as though we 
had the original graph (£o ; ro) with no removed links. 
Since the class of universality does not depend on Jo as 
soon as c > it follows that the critical behavior of this 
class of generalized small-world models is the same for 
any p £ [0, 1] as soon as c > (45| . 



C. Correlations of two given spins and correlations 
of two spins at given chemical distance 

The quantities of major interest are the averages, and 
the quadratic averages, of the correlation functions which 
for shortness will be indicated by C 1 - 1 ' and . For ex- 
ample, the following are non connected correlation func- 
tions of order k: 



C-d) 



(19) 
(20) 



where k > 1 and the indices i\, . . . are supposed all 
different. For shortness we will keep using the symbols 
C' 1 - 1 and C^ 2 ) also for the connected correlation function 
since they obey to the same rules of transformations. We 
point out that the set of indices ii, . . . ,ik is fixed along 
the process of the two averages, with respect to the cou- 
plings (JXTJ) and to the graph realizations (fT8|) . This im- 
plies in particular that, given the spin with index i and 
the spin with index j, once the averages have been per- 
formed, their chemical distance remains undefined, while 
the only meaningful distance between i and j, is the dis- 
tance defined over Cq, which we will indicate as ||« — j\\ . 
Interestingly, for the cases in which (£ ,T ) is a regu- 
lar lattice, \\i — j\\ is an Euclidean distance. Therefore, 
throughout this paper, it must be kept in mind that, for 
example, (| \i — j\ \ ) = {oi&j) is very different from 
the correlation function G 1 - 1 ' (Z) of two points at a fixed 
chemical distance Z, i.e., the minimum number of links to 
join two points among both the links of To and the links 
of the random graph realization c. In fact, if, e.g. for 
the homogeneous case pi = 1/N with Jo — 0, one con- 
siders all the possible realizations of the Poisson graph, 
and then all the possible distances I between two given 
points i and j, one has 



c w (\\i-j\\ ) = M-i^ivj) 

N 

= J2 P nQ)G W (1) (21) 



1=1 
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where here Pjv(0 is the probability that, in the system 
with N spins, the shortest path between the vertices i 
and j has length I. If we now use G^\l) ~ (tanh(/3J))' 
[25l ] (in the P region holds the exact equality) and the 
fact that the average of I with respect to Pn(1) is of the 
order log(A), we see that the two point connected cor- 
relation function (|21[) goes to in the thermodynamic 
limit. Similarly, in the Poissonian graph, all the con- 
nected correlation functions defined in this way are zero 
in the thermodynamic limit. However, as we will see in 
Sec. HID, this independence of the variables holds only 
if Jo = and 7 > 3. Furthermore, even for 7 > 3 finite 
size effects may result in strong correlations in the finite 
network. 



III. AN EFFECTIVE FIELD THEORY 
A. The self-consistent equation 

Depending on the temperature T, and on the param- 
eters )jl and those of the probability distributions, dfx(-) 
and dfio(-), the small-world model may stably stay either 
in the paramagnetic (P), in the ferromagnetic (F), or in 
the spin-glass (SG) phase. In our approach for the F and 
SG phases there are two natural order parameters that 
will be indicated by m( F ) and m^ SG \ Similarly, for any 
correlation function, quadratic or not, there are two nat- 
ural quantities indicated by and C^ SG ^ , and that in 
turn will be calculated in terms of and m^ SG \ re- 
spectively. To avoid confusion, it should be kept in mind 
that in our approach, for any observable 0, there are - 
in principle - always two solutions that we label as F and 
SG, but, as we shall discuss soon, for any temperature, 
only one of the two solutions is stable and useful in the 
thermodynamic limit. 

In the following, we will use the label to specify that 
we are referring to the pure model with Hamiltonian ^ . 
Note that all the equations presented in this paper have 
meaning and usefulness also for sufficiently large but fi- 
nite size N. For shortness we shall often omit to write 
the dependence on N. 

Let moi(j3Jo, {/3hj}) be the stable magnetization of the 
spin i in the pure model {2]| with coupling Jo and in 
the presence of a generic external field {hj} at inverse 
temperature /3. In Appendix B we prove that the order 
parameter or to ( - sg -' of the model defined in Eqs. 

©-([7]), with the condition a < 1 (equivalent to 7 > 2) 
satisfies the following self-consistent equation 



] m 0i (p4 S) ; {NpjCt^m^ + /3h}) Pl , (22) 



where the effective fields t^ F \ t^ SG \ and couplings Jq 
and Jq SG ^ , are given by 



(F) 



(.(F) - 



dn(J) tanh(/3J), 



(23) 



t (SG) = 



tanh(/3jf } ) = (1 -p) I dfxo(Jo) tanh(/3J ), (25) 



J d/i(J)tanh 2 (/3J), (24) 



and 



tanh(/3jf G) ) = (1 - p) I dfi (J Q ) tanh 2 (£J ). (26) 



Note that I J^ F) | > J^>. For later use we introduce also 
the short notations 



r (SG) 



4 F > *> tanh^), 



and 



t 



(SG) def 



n = J tanh(/3J^ SG) ). 



(27) 



(28) 



The meaning of the order parameters mA s ) is quite nat- 
ural being given by 



(29) 



where 1% = 1,2 for S =F or SG, respectively. 

The free energy density coming from Eq. ([13")) 
involves a generalized Landau free energy density 
from which it differs only for trivial terms independent 
from m( s ) . The complete expression for in terms 
of L( s ) is reported in Appendix C. The term reads 
(/3/( s ) = trivial terms +L^/l^ s \ with =1,2 for 
£ =F, SG, respectively), and is given by 

0/o (Vf } , {N Pj ct^m^ + ph}) , (30) 

fo(f3Jo,{0hi}) being the free energy density of the pure 
model ([2]). For given j3, among all the possible solutions 
of Eqs. (|2"2"|) , in the thermodynamic limit, for both E=F 
and S=SG, the true solution fh^, or leading solution, 
is the one that minimizes L^ s \ 

Finally, let k be the order of a given correlation func- 
tion C' 1 - 1 or C'- 2 '. The averages and the quadratic aver- 
ages over the disorder, C^ 1 ' and are (see Appendix 
B for details): 

C« = C (F) , inF, (31) 

C (1) = 0, kodd, inSG, (32) 
c (i) = C (SG)^ keven> inSG; (33) 



and 



C (2) = ( C ( F >) , i 
C (2) = ^(SG)j 



in F. 



SG, 



(34) 
(35) 
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where for sufficiently large N 

= C {pj^ ] -{N Pj ct^m^+(ih}) 

O (^) , (36) 

where in turn Co(/3Jo, {fihi}) is the correlation function 
of the pure model ([2]), and finally 8 > 1 only for k = 1, 
while in general 0<<5<lforfc>l and 5 = if 7 < 3 
(see Sec. ITlTDl) . 

From Eqs. (|34|) and (|35[) for fc = 1, we note that the 
Edward- Anderson order parameter [26| C^ 2 ^ = (a) 2 = 
q EA is equal to (C (SG) ) 2 = (m (SG) ) 2 only in the SG 
phase, whereas in the F phase we have q E A = (m^) 2 . 
Therefore, since m' SG ^ 7^ m^ F \ mS SG ^ is not equal to 
Jq~EA\ in our approach m( SG ) represents a sort of spin 



glass order parameter [27J. In general, our method is able 
to establish exactly the phase boundary P-F and P-SG, 
but not the frontiers F-SG when both the order param- 
eters give a non zero solution. Furthermore, while Eq. 
([29]) for £ =F can be derived, for £ =SG it remains only 
a plausible ansatz (see discussion at the end of the Sec. 
VII A of the Ref. [IJ]). Note however that, at least for 
lattices £q having only loops of even length, the stable 
P region is always that corresponding to a P-F phase di- 
agram, so that in the P region the correlation functions 
must be calculated only through Eqs. (f3"Tj) and ([M]) . 

As an immediate consequence of Eq. ([22]) we get the 
susceptibility x^ of the model (throughout the paper 
we will use only the dimensionless definition of the sus- 
ceptibility) 



-(E) dej 



ph} 



dtfh) 1 _ ctWN^ xo;ij (p^liNpictWmW + ph}) PiPj 



(37) 



r 



where Xo-,i,j stands for the two-points connected corre- 
lation function of the pure model 



def 



I -J 



T 3>0 



i/o- 



(38) 



Note that, as it is evident in all the above equations, 
even when the pure model in the presence of a uniform 
external field is translational invariant, for any non zero 
value of the order parameter m^ s ', the disordered model 
is no longer translational invariant. Note in particular 
that x^ refers to the weighted order parameter ([25)) so 
that it does not coincide with the usual unweighted sum 
of the connected correlation functions. In fact, from Eq. 
([22]) it follows that 



x (s) 



(39) 



'■j 



B. Critical surface (thermal and percolative) 

Note that, for j3 sufficiently small (see later), Eq. ([22)) 
has always the solution = and, furthermore, if 

77i( s ) is a solution, — m( s ' is a solution as well. From 
now on, if not explicitly said, we will refer only to the 
positive (possibly zero) solution, the negative one being 
understood. A solution m^ s ' of Eq. (|22|) is stable (but 
in general not unique) if 



(40) 



'•J 



{Npict^m^ + /3h}^j p iPj < 1. 



From Eq. ([22]) or from Eq. ([40)) we see that, in the 
thermodynamic limit, the critical surface crossing which 
the system passes from a P region to a non P region 
satisfies 



4 E) ^E^(^ s)j o s) ;o 



PiPj 



1. 



(41) 



'■j 



Eq. (|4Tj) gives the critical surface of the model in the 
plane (/3, c) as a function of p and the other parameters 
of the model {dfio, d/i, {pi})- 



1. Critical Temperature 

For a given value of c Eq. (|4"Tj) provides the critical 
temperature. From Eq. (|22p it is immediate to recognize 
that for Jq ^ 



< 



□(£) 

? c0 i 



(42) 



while /3c = for Jo = 0, where /3^q is the criti- 

(E) 

cal temperature of the pure model with coupling Jg . 
It is clear that, when (£0^0) is n °t translational in- 
variant, there exists an optimal choice of labeling the 
sites i — 1, . . . , N, which gives the lowest pi. , and that 
corresponds to the choice that maximizes the functional 
F p{{Pi})> where 



Fp({ Pi }) d = f cN 



5^X0 



\i,3 (/ 3J Q S) ;°) PiPj- 



We will come back to this interesting issue in Sec. [V] 
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Percolation threshold; clustering versus percolation 
threshold 



The theory can be projected toward the limit (3 — > oo 
where for £ =F we get an effective percolation theory. 
Here the region P corresponds to the region in which, 
in the thermodynamic limit, the parameters (c, co,p) are 
such that no giant connected component exists (m/ F ^ = 
0). Note in particular that, if cq c is the percolation 
threshold of the initial graph (£q,To) (if co c does not 
exist we can set formally cq c = 00) in order to remain in 

the region P, the connectivity c p ' = c (l— p) of the graph 
obtained from the graph (Cq, Tq) in which each link has 
been removed at random with probability p, must satisfy 
co(l — p) < coc, otherwise a giant connected component 
already exists (and the stability condition (|40|) at /3 — > 00 
with m( F ) = is violated). From Eq. (|4"Tj) in the thermo- 
dynamic limit it follows the equation for the percolation 
threshold c c as a function of p 

c c N Xo-,i,j (tanh _1 (l -p);0)p l p j = 1, 



hi 



with c (l-p)<c 0c , 



(43) 



where we have used the fact that lim 1 g_>. 0o tanh(/?jQ ) = 
tanh(l — p). Alternatively, Eq. (|43|) can be rewritten in 
terms of only graph elements as 



,N 



E 



kj + J^ouj ) PiPj = 1: c (l -p)< c 0c , (44) 



A special case is the one in which pi = 1/N; i.e., the 
classical small- world (no heterogeneity) . In this case Eq. 
(|4*3"f simplifies as 



c[, p c ) pxo(tanh- 1 (l- J3 );0) = l, c p) (l 



■p) < coc (46) 



So, for example, if (Cq,Tq) is the Erdos-Renyi random 
graph 15] (in the canonical representation), with mean 
connectivity cq, from (valid in the P region) 



Xo(/3^o;0) 



1 — cq tanh(/3 Jq) ' 



(47) 



to be inserted in Eq. (|46|) , we get back obviously the well 

(%>) 

known percolation threshold c 0c ~ 1, independently of 
the value of p. Depending on the problem, given Co < co c , 
in general one can be more interested in reading Eq. (|4"3")l 
either as an equation for p or for c. We can consider for 
example the case in which (Co, To) is an ensemble of arbi- 
trary disconnected finite clusters (dimers, triangles, . . . , 
or mixtures of them), for which there is no percolation 
threshold (or formally c c o = 00). For example, for a set 
of N/2 disconnected dimers (cq — 1), N/3 disconnected 
triples (co = 1x2/3+2x1/3), A/3 disconnected triangles 
(c = 2), N/4 disconnected squares (co = 2), and A/5 
disconnected pentagons (cq = 2), we have respectively: 



xo(/3J ;0) 



apJo + 2e~ l3J <> 



(dimers), 



(48) 



where A/q^j = 1 if, in the graph (£o,r ) from which 
each link has been removed at random with probability 
p, between the vertex i and the vertex j there exists at 
least a path of links, and A/J^j = otherwise. 

Given p, if the condition co(l — p) < co c is not satis- 
fied, then a giant connected component is present and we 
can set c c = 0. It is interesting to see in more details the 
case in which we choose c = cop so that, as we vary p, the 
total connectivity is fixed and equal to Co (the "rewired" 
small- wor Id) . This study is important since it leads us to 
understand how the presence of short loops affects dif- 
fusion processes on general networks. In particular, a 
strong interest regards the question: "In the presence of 
short loops how does the percolation threshold change"?. 
If we set c = cop, from Eq. (|4"4"]l we get the percolation 
threshold cq c as a function of the rewiring parameter p 



( Or 



• /v 0;ij" 



PiPj 



1. 



p)<coiA5) 



1 9e 2 ^ Jo + 2 + 2e~ 2l3Jo 
Xo(/3Jo;0) = - eWo+2 + e _ 2/3Jo (triples), (49) 



3g3/3Jo _|_ g — f>Jo 

MPJo\0) = e3pJo+3e _ fiJo (triangles), (50) 



Xo(/?Jo;0) 



4 e 4/3J 



e 4/3J + 7 



(squares), 



5e 5/3Jo + H e /3Jo 
e hf3J + 15 e /3J 



(51) 



(pentagons). (52) 



If we consider the case with no heterogeneity pi = 1/N , 
from Eqs. (|gg ]l -([52" ]) plugged in Eq. (g3J» for p = 0, we 
get respectively the following percolation thresholds c c : 



= 1/2 (dimers), 



(53) 



From Eq. (|4"S"|) we see that p has two effects on : the 
pref-actor p in the lhs of Eq. (1431) tends to decrease 
while the other tends to decrease Afn P } 4 and then to in 



crease c^J . However, as we shall see soon, in general c J 
decreases with p due to the general mechanism according 
to which clustering diminishes the percolation threshold. 



0;i,j 



(p) 



c c = 1/3 (triples), 



c c = 1/3 (triangles), 



c c = 1/4 (squares), 



(54) 



(55) 



(56) 
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c c = 1/5 (pentagons). (57) 

and, in general, for polygons of m > 3 sides (crj = 2) 

c c = 1/m (polygons of m sides). (58) 

Notice that the clustering coefficient for dimers and 
triples is zero, and for closed polygons of to sides de- 
creases with to. Of course one recovers that c c = 1 /to, — ¥ 
for to — ¥ co since an ensemble of N/m disconnected 
polygons of length to for to = N — > oo becomes equiv- 
alent to a closed chain for which we already know that 
c c = 0. Eqs. (|48H52j) can be used in general also for 
p > 0. So, for example, from Eq. (|4"6")l and ([50)1 . by us- 
ing the replacement (3Jo — > tanh (1 — p), we get the 
equation for the percolation threshold p c of an ensem- 
ble of disconnected triangles (cq = 2) from which each 
link has been removed with probability p (c^ = 2p) and 
"rewired" as a "long-range" link: 

2g3tanh _1 (1— p) _j_ g— tanh -1 (1— p) 
^gStanh-^l-p) _|_ 3g-tanh- 1 (l-p) = 1 ' 

In Fig. (fTJ) we plot the lhs of Eq. (|59p as a function of p. 
Eq. J59J is solved for p c = 0.183406. 



many different paths), so that Ylj-^"o;i,j will be greater 
which in turn will give rise, via Eq. (|45j) . to a smaller 
clustering coefficient. And similarly for A/q^- for any 
given p. In conclusion, as already discussed in (28l - [30| . 
clustering increases the percolation threshold. Equation 
(|55|) for the polygons represents a clear example of this 
mechanism for the particular choice Co = 2, p — and 
Pi = l/N. 

We conclude this Section with a remark on the re- 
cent methods used by Newman Q and Gleeson [l2| by 
which families of clustered networks are introduced and 
analytically exactly solved by generating function tech- 
niques. Although these networks have a finite clustering 
coefficient, they can still be mapped to effective tree-like 
graphs. So, for example, for the ensemble of disconnected 
finite clusters as the ones we have analyzed in Eqs. (|4"5)l - 
(fS"5)) . we could also use the method Q to solve the per- 
colation problem [46| , but not for example the case in 
which (Co, To) is a do dimensional lattice. In fact, the 
main condition which allows the methods Q or [l2[ to 
be applied is the absence of overlaps among the module- 
elements (links, or triangles, or any kind of finite cluster) 
while, for example, in a two-dimensional lattice we have 
always overlap among the square "module-elements" . 



ON 




FIG. 1: Plot of the Left Hand Side of Eq. (59]) ((£o,r ) 
is a set of disjoint triangles) as a function of the dilution 
probability p. 

Let us come back now to the general heterogeneous 
case. From Eq. (|45|) we see that, given two regular 
graphs (Co, Tq) and (Co,T' ), both having the same av- 
erage connectivity Co = c' (so that |Tq I = (Tol), between 
(C , T ) and (C ,T' Q ), the sum in the lhs of Eq. gS]) will 
be greater for the graph having the smaller clustering co- 

(p) 

efficient, which in turn will result in a lower value for c Qc . 
In fact, given a vertex i and its local connectivity Co(i), 
the smaller is the clustering coefficient around the ver- 
tex i, the larger will be the number of different vertices 
j connected to i (while when the clustering coefficient is 
large a same vertex j will be reached from the vertex i by 



C. Critical behavior 

In this section we prove that the critical behavior of 
an arbitrary heterogeneous graph as defined through Eq. 
([5]), which in particular includes scale- free graphs, is ro- 
bust with respect to the addition of any graph (Co, To), 
provided (Co, To) is not in turn a heterogeneous graph. In 
[14| we have shown this result for the homogeneous small- 
world model corresponding to the case pi = l/N. More 
precisely the critical behavior for pi = 1/iV and p = 
has been shown to be classical mean field for t r > > 0, 

while for t < first-order phase transitions are also 
possible (see also [3l[). Here we will restrict the analysis 
only to the case t Q F ^ > 0. First of all from Eqs. ([57| 
and (I4ip we observe immediately that the critical expo- 
nents for the susceptibility, above and below the critical 
temperature, are both equal to 1. Note in particular that 
above the critical temperature and zero external field the 
susceptibility can be written in the simpler form 

... EiPiEifcufofMo}) 

= T^W> " (60) 

Let us now turn to the analysis of the order parameter 
near the critical point. For Jo = 0, i.e., for the pure 
static model, we have 

maiipJ^liPhj}) = tanh(/3/K) (61) 

so that the self-consistent equation (|22|) strongly simpli- 
fies in 

m (s) = 5(to (s) ) (62) 
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where 



g(m^) = f ^tanh(7Vp. iC i( s W s )) Pl . 



(63) 



32] 



The critical behavior of pure static model, i.e. with 
Jo = 0, for the scale- free choice (fTOl - lfTTj) , has been stud- 
Let us focus on the P-F transition. 
62} is equal to Eq. (21) of [32]. We 



ied in the Ref. 
For £ =F, Eq 
recall that, due to the power-law character of the dis- 
tribution {pj}, we cannot derive the correct critical be- 
havior by simply expanding in the sum in g(m^) term 
by term for small m^ F \ As shown in [32], it is neces- 
sary to keep track of all the terms of the sum present 
in <?(m( F '). This is done by evaluating the sum with 
the corresponding integral which gives rise to a singular 
term proportional to (m( F )) 7_2 plus regular terms pro- 
portional to (m^), (m^- 1 ) 3 and so on. As a consequence, 
when we solve the self-consistent equation to leading or- 
der in to/ f ' , if T and r indicate the temperature and the 
reduced temperature, respectively, we get the well known 
anomalous mean-field behavior: to*- f ) ~ C^r 1 / 2 ) (i.e. 
classical mean-field) for 7 > 5, m^ F ' ~ (9(t 1 ^ 7-3 ^) for 
3 < 7 < 5, and ~ o(T-(7-2)/(3- 7 )) for 2 < 7 < 3. 
Note that t he c ritical behavior of the order parameter 
m ( F ) = £\ (ui)pi is different from the unweighted one 
defined as to = J^i ( a i)/N when 2 < 7 < 3. In such a 
case from Eq. (|36|) one can use to ~ t^m^ from which 
it follows that m - o(T -1 /(3-7)) f or 2 < 7 < 3. 

Let now be Jo 7^ 0. It is clear that if the graph (Co, Tq) 
is in turn a pure scale free graph with exponent 7', then 
the joined network will have an anomalous critical be- 
havior characterized by the minimum between 7 and 7'. 
Less obvious is to understand what happens if (Co, To) 
has a finite dimensional structure or some special topol- 
ogy with short loops. In particular we can pose the ques- 
tion: docs the critical behavior change by adding, via 
short loops, many paths between far spins, or may the 
critical exponent for to depend on Jo? Let us consider 
the self-consistent equation (|2"2")l in general. The exact 

expression of TOo^/SJq^ ; {/3hj}) for a generic non homo- 
geneous external field {hj} represents a formidable task. 
Note that, as above mentioned, to analyze the critical 
behavior we cannot expand for small fields {j3hj}. We 
can however perform an expansion to the lowest order 



in t 



(F) 



tanh(/3J 



(F) 



). It is then easy to see that, for 



{hj} 7^ 0, at the order 0(t^) we have 

m 0l (f3J ; {Phj}) = t&nh(f3h t ) + 

4 F) [l-tanh 2 (/%,)] tanh(j8Aj 



(64) 



where Afo(i) is the set of the first neighbors of the vertex 
i in the graph (Co, To). It must be said that without the 
condition {hj} 7^ Eq. (|64l) might be wrong since the 

lowest non zero terms in t would involve closed paths 
of at least length 3, while Eq. contains only paths 
of length 1. More precisely, near the critical point, due 



to the fact that the fields {hj} are infinitesimal but not 

(F) 

zero, we can neglect higher order corrections in t . By 
plugging Eq. into Eq. (|2"2"]l for E =F we have 

TO ( p ) = ff ( TO (F) ) + Ai(m< F >) + A 2 (m (F) ), (65) 
where we have introduced 

Ai(m^) d =t^J2Pi J2 tanh(A^rf( F W F )),(66) 

i j'eM)(») 

A 2 (to< f )) t[ F) Y,P^^ 2 {N Pl ct^m^) 

i 

x ^ tanh(iVp J ct (F) TO (F) ). (67) 

both to be compared with the Jo independent term 
g(m^). Let us analyze the bigger contribution Ai(to^ f -*) 
and let us focus on the simpler cases in which the graph 
(£o)To) has a fixed connectivity |A/"o(i)| = Co, where 
|Ao(«)| stands for the cardinality of the set A/o(i). Let 
us suppose first that cq — 1 (i.e., (£0^0) is an ensemble 
of dimers). In general, given any normalized distribu- 
tion pi > 0, different from the homogeneous one, and 
any function f(x) > increasing with x, the following 
property holds 



^2Pif{Pjo(i)) < ^P l f{Pi)i 



(68) 



where jo(i) stands for the first single neighbor of i in 
(£ ,r ), while 



^2pif(pj (i)) = ^2ptf(Pi), 



(69) 



only for pt = 1/N . Note that by definition i — > jo(i) is 
a bijection on Cq and that jo(i) 7^ i. We can however 
formally enlarge the definition of jo(i) 7^ i to include also 
the case jo(i) = i (a self-link). The inequality (|6"8"|) tells us 
that when we choose jo(i) = i we get an optimal overlap 
between the distribution {p{} and the function /(•). For 
the general case |A/o(?)| = c > 1, given a vertex i, we 

can enumerate the cq neighbors of i as ja(i), ■ ■ ■ ,jo° \i)- 
Each upper index I = l,...,co represents an oriented 
axes so that, for each I = 1, . . . ,co, the function j$ (i) 
is a bijection on Cq. For example, if (£0^0) is the one 
dimensional ring, we have the two bijections jfj (i) = i+1 

(2") _____ 

and Jq (i) = i — 1. By applying Eq. (|6"5|) to each oriented 
axes we then get 



1=1 i 



(70) 
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By using Eq. (|70p to our case with fix) = tanh(x) and 
for t F ^ > we see that for > we have always 

< Ai(m( F >) < 4 F) co.9(m (F) ). (71) 

In turn < A2(m' F ') < Ai(m^ F ') and, furthermore, as 
already mentioned - near the critical point - higher order 

(F) 

corrections in t$ will be all lower than the first term 
proportional to t . In conclusion, for £ > 0, from 
Eq. (f2"2"j) and the above inequalities, we get 

s(m< p >) < m< F > < (l + 4 F ) Co ) ff (m( F )) + 

O(t 2 )g(m)+o(g(m^), (72) 

where o(g(rn^ F ') stands for corrections smaller than 
g(m^). In general, for to finite, it is possible to prove 
that 

g(m) < m < xo (iSJ^; o) g(m) + o{g{m)), (73) 

where xoifiJo >0) is the susceptibility of the pure model 
@ with coupling and hi = 0. The proof is given 
in Appendix D. Since near the critical point, in the re- 
gion ftlp > (3 > /3 C , it is XoiftJo^jQ) < °°! we see that 
Eq. ([73"]) implies that the critical behavior of Eq. (|2"2")l 
remains always that corresponding to the term g(m), i.e. 
as if it were Jo = 0. We can finally consider the case in 
which (£0^0) is a Poissonian graph (Erdos-Renyi ran- 
dom graph in the canonical representation) with mean 
connectivity c$. To this aim we can start from the fully 
connected graph and remove from it randomly each of its 
N(N - l)/2 links with a probability p = 1-cq/N; the 
resulting graph will be our Poissonian graph with mean 
connectivity Co- Since we have already proved that when 
(jCojTo) is the fully connected graph with a couplings 
0(l/iV) the critical behavior remains equal to that of 
the model with J = (the effective couplings in this 

(F) 

case being given by tan(/3J ; ) = tanh(/3Jo)co/iV), we 
conclude that also for a Poissonian graph the critical be- 
havior of the small-world model remains the same as it 
were Jo = 0. 

For the P-SG transition of the model with Jo = we 
can evaluate the weighted Edward- Anderson order pa- 
rameter as qEA = (to( sg ') 2 . Since the critical behavior 



of ?7?/ SG ) is identical to that of we get that the crit- 
ical exponent for qEA is is simply given by twice the 7 
dependent critical exponent for mS F ' that we have dis- 
cussed before. This result is in contrast with the one of 
the Ref. [HJ for the region 4 < 7 < 5. The source of such 
a contrast might be related to the already mentioned fact 
that Eq. (|29|) for S =SG remains only a plausible ansatz. 
We do not discuss here further this issue, but we stress 
that, whatever be the critical P-SG behavior of the model 
with J = 0, by applying the same procedure as above 
done for the case P-F, we arrive at the conclusion that 
also the critical P-SG behavior is infinitely robust with 
respect to the addition of any non heterogeneous graph 
(£o,r ). Same conclusions hold of course also for the 
critical exponent of the order parameter of the percola- 
tion problem. 



D. Correlation functions 

Another remarkable consequence of our theory comes 
from Eq. (|36l) . We see in fact that, in the thermodynamic 
limit, any correlation function of the model, at least for 
7 > 3, fits with the correlation function of the pure model 
but immersed in an effective field that is exactly zero in 
the P region and zero external field ({h — 0}). In other 
words, in terms of correlation functions, in the P region, 
the small-world model and the pure model are indistin- 
guishable (modulo the transformation J — > Jo SG ^ f° r 
E =SG). Note however that this assertion holds only for 
a given correlation function calculated in the thermody- 
namic limit. In fact, the corrective 0(1/N S ) term ap- 
pearing in the rhs of Eq. ([36)) cannot be neglected when 
we sum the correlation functions over all the sites i G Cq , 
as to calculate the susceptibility; yet it is just this correc- 
tive 0(^/N s ) term that gives rise to the singularities of 
the model. More precisely, for the two point connected 
correlation function defined as 

xS ^ M^-ia^ia^, (74) 

where ' s = 1, 2 for S = F, SG, respectively, we have 



xg } - XwAP4^{NPjCtWmW + f3h}) + 

d (s )iV Ej Xo-MPJq^ } ; {N Pq ct^m^ + (3h}) Pl E^nXo^jf } ; {N Pq ct^m^ + ph}) 

1 - ctWNJ2l, n X0;l,n (p jf } 5 { Np qC tV) m V) + fiJl}) PlPn 
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where the dependence on N in xYf an d X,0;i,j are understood. In the homogeneous case pi = l/N Eq. (l75t becomes 



which, when (£o>ro) is in turn homogeneous, reduces to [Tij 

xg } = Xo ;i ,i(/3jf ) ;^ E )m( E )+^) + 



(76) 



ct^) 




2 


N !_ 


ci (s) Xo (/3J (S) ;c*( s )m( E ) + 





(77) 



Eq. (|75p is easily obtained by derivation of the mean- 
field equation ([22)) generalized to the case of an arbitrary 
external field {hi} (see Appendix E). Eq. ([75jl clarifies 
the structure of the correlation functions in general small- 
world models. In the rhs we have two terms: the former is 
a distance-dependent (the distance, if any, defined in the 
graph (£ , T )) short-range term whose finite correlation 

length, for T ^ T c0 ; , makes it summable (over all the 
nodes the latter is instead a term which takes 

into account the heterogeneity of the system - possibly 
power law like - also in the P phase, which turns out to 
be summable thanks to a global 1/N S factor, where 8 is 
the exponent appearing in Eq. Q36p. For the two point 
connected correlation function, at least for the case in 
which (£o: To) is a regular lattice, as will be clear in the 
next Section, 8 takes the value: 



^f, for 7 >3 
0, for 2 < 7 < 3. 



(78) 



Once we perform the weighted sums with the distribution 
{pi}, both the terms in the rhs of Eq. (|75|) give a finite 
contribution to the susceptibility. It is in fact immediate 
to verify that by inserting Eq. ([75} in Eq. (|3T)|) we get 
backEq. (|37j). 

We see here a novel fact: in scale free models in finite 
but large systems, correlations between two given spins 
can be power law like even above the critical surface. 
Furthermore, we see from Eq. (1781 that such phenom- 
ena become persistent even in the thermodynamic limit 
when 7 < 3. At this point, it is worth to compare these 
scenario, with the scenarios one has in other systems. By 
focusing only on the second term of the rhs of Eq. ([75)1 
we find the following. In finite d-dimensional models, ac- 
cording to the Ornstein-Zernike form [331 ], at any T but 
the critical one T c , one has exponentially small correla- 
tions, while at T c the correlation function decays as a 
power law with the distance with an exponent d — 2 + rj, 
where 77 is the critical exponent of the correlation length. 
Roughly speaking, this implies that in finite dimensional 
models there are essentially two possible correlations for 
near (i.e. at a distance O(l) at T ^ T c ) and far (i.e. 
at a distance 0(N) at T = T c ) spins, with values 0(1) 



r 



and 0(1/N d ~ 2+V ), respectively, and the total number of 
such couples of spins are 0(N) and 0(N 2 ), respectively. 
In the fully connected model with a coupling 0(l/iV), 
or in classical random graphs, or in homogeneous small- 
world models, at any T the correlation function decays 
instead as l/N for any couple of the N(N — l)/2 spins, 
with no spatial dependence (the correlation length goes 
to infinity). As will be clear in the next Section, in 
heterogeneous small-world networks with a power law 
degree distribution fc~ 7 , at any T we can instead dis- 
tinguish three families of correlations: given two spins 
that are both far from an hub, they have correlations 
0(1/N), and the total number of such couples of spins 
is of the order (j(aN 2 ) with a < 1; given two spins, one 
of which is an hub and the other not, they have correla- 
tions 0(1/-/V^ 7 ~ 2 '^ 7_1 ' ) ), and the number of such couples 
of spins is 0(bN), where b is a decreasing function of l/ 7 ; 
finally, given two spins which are both an hub, they have 
correlations CKl/TV^ 7-3 ^ 7-1 )), and the number of such 
couples of spins is O(l). 



IV. EXAMPLES 



In Sec. IIII B 2l we have seen some simple applications to 
the homogeneous case (pi = l/N). Here we discuss some 
examples where we can apply, analytically, the general 
results of the previous Section to the heterogeneous case. 
Since we have already solved the issued for the critical 
behavior we will focus only on the critical surface and on 
the correlation functions. 



A. Viana Bray on the scale-free graph 

In this case Jo = so that there is no additional graph, 
for historical reasons we refer this as the Viana Bray 
model [34| on the scale-free graph. This model was solved 
in (32l | , and for the network version called "configuration 
model" (which is a network realization slightly different 
from the hidden variables network) the Ising model was 
already extensively studied in [24[ almost one decade ago. 
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Since Jo = for mo we can use Eq. ([61]) from which in 
particular it follows that for (3 < /3 cQ we have Xo-.i.j = 
By inserting this in Eq. ([41]) we get the critical surface 



ct 



which, for large A~ under the choice (]10I) - ([TT]) gives 
(I'M) 2 



c (1-2^) 



(1- jV 2 ^- 1 ) = 1. 



(79) 



(80) 



The critical surface given by Eq. ([79]) coincides with the 
one found in [32j. Note that N^ li p 2 is related to the 
second and first moments of the degree distribution P(k), 
(k) p — c and (fc 2 ) p , in terms of which Eq. ([79]) becomes 
identical to the critical surface valid for the pure scale 
free graph obtained by using the configuration model [2~H 
when (k 2 } < oo (note however that Eq. ([80]) is valid in 

general also when 1 < 2/i < 2 where (k 2 ) = oo): 



(fc 2 ) P - 
(k) p 



= 1. 



(81) 



As anticipated before, we find instead a complete novel 

~(£) 

result for the correlation function xl j of two given spins 
i and j. Let us consider only the case E =F in the P 
region and let us consider the choice pU|) - (TTT|) . From Eq. 

([50)) we see that, when TV grows, t c F) and in the P 
region remain finite for 2/i < 1, while they go to for 
2/i > 1 (logarithmically for 2/i = 1), therefore, in the 
latter case, for finite N, we can evaluate the correlation 
function at a temperature scaling with the critical one. 
In conclusion, from Eq. ([80]) and Eq. f|75fl applied with 



Xo;i,j\{h,=o} — in the finite network, for 2/i, < 1 and 
at any temperature above the critical one we have 

(P) tW (1-2/x) fa')-" f82l 

" M + if)(l-iW/4 F ))A r1 - 2 ' 1 ' ( j 

whereas for 2/i > 1 at any temperature scaling with the 
critical one and in the P region (/3 < /3 C ) we have 



.(F) , g (2/i-l) 



0< F) (1-/3//T0 



(F) 



(83) 



where we have made use of the fact that, up to negligible 
terms for A" large, /tc — f3/fi c F \ By using pi ~ 
(ki}/J2j(kj)> (hi) b em g the average degree of the vertex 
i, we can express approximately Eqs. (|82p and ([53"]) in 
terms of the vertex degree as 



~(F) 



t (F) 



(1 - 2/i) 



UJ " l ' 3 t { P(l-ri 2 (l-t(r)/t ( P) (k) 2 p N 
for 2/i < 1, and 



(84) 







(2/i - 1) 



fa) (hi) 



, (85) 



for 2/x > 1. However, by using only Eqs. (|75|) and (|79l) . 
we can get the correlation function in a form which is 
completely independent of the form for the pi's 

«" (WW 



-(F) 



(l-i( F )/4 F) ) Wp^V 



Comparison of Eq. (j86|) with Eqs. (J82J) and ([83]) shows 
that the strongest correlations involve the nodes i's with 
the highest degree with: (A*) — OiN 1 *) for /i < 1/2 (7 > 
3), and (hi) ~ CK^ 1 / 2 ) for /x > 1/2 (7 < 3). 



B. "Gas" of dimers in a scale- free network 

Here we consider the case in which (£o,ro) is a set 
of A" disconnected dimers (so that there are 2A~ sites). 

This case represents the simplest example with Jo 7^ in 

(s) 

which rriQi(l3J Q , {/3/ij}) can be exactly calculated. We 
have 



where f = tanh(/3Jg ; ) and jow stands for the first 
neighbor of i. By derivation we get the correlation func- 
tion of the pure model Xo;i,j which, in the P region, takes 
the form 



(S) 

tanh(/3/ii) + t tanh(/3ft,j ( i )) 



j = jo(*)- 



Therefore for the critical surface we have 



ct^N 



,PiPjo(i) 



= 1. 



(89) 



With respect to the critical surface of the model with 
Jo = (the above Viana-Bray case) we see in Eq. ([59"]) 

(£) 

the presence of a term proportional to t . How much 

(£} 

this term affects t c depends on how the dimers are 
placed, i.e., on how we choose the first neighbors {jo(i)}- 
Since by definition the dimers are not connected, in gen- 
eral for jo(i) we can take jo(i) = i + k, mod A~ where k is 
a constant integer in the range [1 , N] . The exact evalua- 

tion of t c for A" large remains simple only if k does not 
depend on N or k = O(N). Under the choice (fTU]) - ([TT]) . 
for the former case we get 



(1-2/i) 1 >~ ' 



(90) 



whereas for the latter the critical surface remains not 
affected by t^ as in Eq. ([80]). When fc does not grow 
with N, for the correlation function for the E =F case in 
the P region for 2/i < 1 we have 



t (F) 



Xo 



(1 - 2/i) 



4 F) (i+t< F ')(i-^M F) ) 
^+4 f) (jqW)" m ][j- m +*o f) u(j-))- m 



{,91) 
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whereas for 2/j > 1 at a temperature scaling with the 
critical one we have 



-(F) 
v 



XOy, 



(2/i - 1) 



" ft m (i+tj")(i-wn 

+ 4 F) (JoW)^][j^ + 4 F) (Jo(j))^](92) 



.(F) 



(F)n 



Similar expressions hold for the correlation in the case in 
which k — 0(N), the only difference being the absence 
of the pref-actor 1/(1 + t^). More in general, indepen- 
dently of the form for the p^s we, in terms of the average 
degrees we have 



-(f) 



s 



(l-*(F)/ff)) 



t (F), 



(k) P N 



(93) 



C. A one dimensional chain through the scale-free 
network 

Here we consider the case in which (Co, To) is a a one 
dimensional chain with periodic boundary conditions and 
such that the first site of the chain corresponds to the site 
i = 1 of the static network, the second site of the chain 
corresponds to the site i = 2 of the static network, and 
so on. As we have learned in Sec. Ill C, this or any other 
choice will not alter the critical behavior of the whole 
system that remains the same as in the absence of the 
chain. In the P region the correlation function of the 
pure model is given by 

Xo; i ,i( i 8jf ) ;0) = [4 E) ]^-l, (94) 
from which by using Eq. (|41[) we get the critical surface 



(95) 



Let us consider the choice (riT^ - pTj) . For |ig | << 1 we 
need to keep track only of the term O(to ) and for N 
large we get 



ct 



(2) 



(l + 2ffi)(l- M ) a Ar2u _ 1} 



(1 - 2/i) 



(96) 



In general Eq. (|96|) is exact only in the region 2/i > 1 

(£) 

so that t cQ — > for TV — > oo. Notice the difference with 
respect to the gas of dimers case in Eq. (|90|) for the 
presence of a factor 2 in front of the term proportional 
to t c0 . When \t '\ << 1, for the correlation function 
for the £ =F case in the P region with 2/i < 1 we have 



4 F) (i-i( F V4 F) ) 



(l + 24 F) )fa-)- M 



(97) 



whereas for 2/^ > 1 at a temperature scaling with the 
critical one we have (with a better approximation) 



y(F) „ r f (F)i |,--»| , P 



(98) 



where we have approximated £ + 1 ~ i — 1 c± i. The 
analytical evaluation of the lhs of Eq. ([§5"]) for finite 
remains a difficult task and we have to resort to a nu- 
merical evaluation at a sufficiently large value of N such 
that finite size effects become negligible. As we have just 
learned, finite size effects can have a very slow relaxation 
rate in scale free graphs; in evaluating the correlation 
functions, when fi < 1/2 (7 > 3) they decay as slowly as 
while they persist even in the thermodynamic 
limit when fi > 1/2 (7 < 3). As we have seen above, 

however, we can easily handle the latter case since tg is 
always small. We see then that the most difficult numer- 
ical task in the evaluation of the lhs of Eq. , as well 
as in general formulas involving sums of correlation func- 
tions, occurs in the case of a distribution with /1 — > l/2~ 
(7 -> 3-). 

In Figs. we plot simulations for the susceptibil- 
ity x an d for the Binder Cumulant U (35| . respectively, 
as a function of the temperature T for several system 
sizes N and compare the location of the maximums with 
the theoretical T c evaluated at a very large value of N 
where we observe stationarity within the statistical er- 
rors. Finally in Fig. ([3]), for growing but finite sizes 
N, we plot the position of the "finite size T C (N)" , de- 
fined as the position of the maximum of the susceptibil- 
ity x w ith respect to the temperature. We evaluate such 
quantities for both simulations and theoretical data of 
the same system as a function of N 1 / 2 . Note that the 
latter evaluation coincides simply with the solution com- 
ing from Eq. (|95[) . From Fig. we find confirmation 
of two facts: i) Eq. (|95j) (as well as all the effective field 
theory in general) has a clear meaning also at finite sizes; 
ii) since for a mean- field universality class it is expected 
to be at criticality X C {N) ~ N 1 / 2 [3g|, as also confirmed 
in [31j . and since, on the other hand, from Eq. (|60|) for 
finite N we have Xc{N) - 0(1)/(T C (N) - T c ), we get 
T C {N) - T c + Oili/N 1 / 2 , in accordance with Fig. ©. 



V. APPLICATION TO NETWORK DESIGN 

As we have seen in Sec. IIIB2, if (Co, To) is a homo- 
geneous graph, i.e., its adjacency matrix Co- t ij has some 
periodicity, clustering increases the percolation thresh- 
old. A different question arises instead if between the 
{pi} and the {co ; jj} there is some correlation. Given the 
desired degree sequence and then the weights {pi}, we 
see that, if (£0^0) is not translational invariant, we can 
optimize the percolation by labeling the sites in such a 
way that the functional -Foo({Pi}) is maximized, where 
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FIG. 2: (Color online) Plots of the susceptibility \ (top 
panel), and of the Binder Cumulant U (bottom panel), as 
a function of the temperature T for the random model (JSJ-JS} 
in which (jCq,To) is a one dimensional chain and the random 
network is generated via the choice (|10[) - (|11[ ) with /j, = 1/3 
(corresponding to 7 = 4). The other parameters of the model 
are: c = 1, J = Jo = 1, and p — 0. The vertical line comes 
from the solution of Eq. J95J with N = 131072. 



(as before here p is the probability by which each link of 
the pure graph (Cq, Tq) is removed) 



F 00 ({ Pi }) =' cN^XoiiA^'^l-PY'tyPiPj- (99) 

Alternatively, Eq. can be rewritten in terms of the 
graph elements of (£0^0) as 

FUiPi}) = cNY, (S id + A/- ( fi) PiPj . (100) 



where -A/gV^ = 1 if, in the graph (Cq,Tq) from which 
each link has been removed at random with probability 



FIG. 3: Plots of the "finite size critical temperature" T C (N) 
as a function of the system size N for theoretical (dots) and 
for simulation data (crosses) of the same system of Fig. J2). 
We stress that, though the accordance between the theoretical 
and the simulation data is poor for relatively small values of 
N, as explained at the end of Sec. IVC, the two trends for 
large TV must fit with a TV 1 / 2 behavior and approach the same 
value in the limit TV — > 00. The figure confirm our analysis. 



p, between the vertex i and the vertex j there exists at 
least one path of links, and Af^lj = otherwise. 

Once the {pi} that optimizes i^oolfe}) has been found 
through a suitable labeling, the corresponding network 
will have in general a percolation threshold c c given by 
the equation ^^({Pi}) = 1 that is a minima with re- 
spect to all the possible TV! labelings. From Eq. 
we see that a simple approximate heuristic receipt to ap- 
proach this optimum consists in choosing a labeling of 
the weights {pi}, ii, £2, • • • j such that 



Pi > Pj 



XOy, 



> 



Xoy, Vi,je£ (101) 



where xo ; i(tanh~ (1 — p);0) stands for the total corre- 
lation of the graph (Co,Tq) at zero temperature at the 
point i: 



def 



X0\i 



or alternatively 



^X0;i,j(tanh 1 (l-p);Q), 



XOy, 



/ / v 0;»,j' 



(102) 



(103) 



i.e., xo-,i can be seen as the average total number of nodes 
connected to i (including the node i itself) in the graph 
(Co, Tq) from which each link has been removed at ran- 
dom with probability p. 

Our optimal design problem can be precisely formu- 
lated as follows. Given a graph (£o,Tq), in which each 
link is removed with probability p, and given a de- 
sired additional degree sequence {fci} (proportional to the 
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weights {pi}) having an average connectivity c, we have 
to place the L — cN/2 additional "long-range" links on 
(Co, To) in such a way that the resulting graph has a 
maximal percolating cluster. Within our effective field 
theory this task amounts to say that i^oo({Pi}) is maxi- 
mized. As we have explained in [37[, however, a network, 
at least in the absence of congestion [38[, benefits from 
optimal communication features at the percolation point. 
Adding further links after this point makes the network 
less sensitive to signals. On the other hand if, for a given 
value of c, we have found an optimal labeling which maxi- 
mizes foo({Pi})> from Eq. we see that changing only 
c will leave still the choice of the 

labeling as an extremal choice for Foo({pi}). There- 
fore, we can speak of label optimization for -Foo({pi}) 
regardless of the value of c. In particular, after find- 
ing the optimal labeling, we will be free to choose for c 
a value such that -Foo({.Pi}) = 1, so that we will be in 
the percolation threshold. Among all the possible other 
labelings the network will have a minimal percolation 
threshold. This implies that for the found optimal la- 
beling the graph will benefit of optimal communication 
features but with minimal cost (if the cost is given by c). 
Our design strategy is therefore in the same philosophy 
of [1^1 where the optimality was defined with respect to 
synchronization. Although in general these two different 
criteria of design may give rise to different networks, we 
argue that, in the absence of congestion, some general 
properties about efficient communication are shared 

A particularly interesting case is the one in which the 
graph (Co, To) is splitted into disjoint subsets, that we 
could then call isolated communities. In |37| we had 
considered the problem of percolation for a generic set 
of 11 communities, isolated or not, in which the addi- 
tional "long-range" links were defined through an addi- 
tional n x n matrix c of intra- (inside the community) 
and inter- (among the communities) connectivities. In 
that problem the unknown quantity to be found was the 
critical matrix c at which percolation sets in, and it was 
easy to find that the critical c must satisfy the equation 



det(l - xo ■ c) 



0. 



(104) 



Xo being the matrix of the relative intra- and inter- 
susceptibilities among the communities. In particular Eq. 
(|104[) for the case in which (Cq,Tq) is simply a disjoint 
set of nodes becomes 



In general, in this kind of problem one can find several 
solutions that represent local maximum, but the asym- 
metric ones, if any, are those which guarantee better com- 
munication performance [37| . This fact is reminiscent of 
the so called "star-like" configuration, which is known 
to provide the best communication/searchability perfor- 
mance in the absence of congestion [38[ . In the problem 
considered in (3?]], however, the additional "long-range" 
links were uniformly distributed among the communi- 
ties, though with the use of n x n different average con- 
nectivities c( l ' m \ Here we face instead the problem in 
which we have one single additional connectivity c, but 
the "long-range" links follow a generic desired degree se- 
quence {pi}, which in particular can be scale free. We ob- 
serve that, in the case in which the graph (Co, To) is split- 
ted into n disjoint communities, (C Q 1 ' , Iq ), I = 1, . . . ,n, 
the heuristic solution (jlOlf) provides the exact minima 
for Foo({pi}) when all the communities have equal size 
and are internally homogeneous (i.e., Xo-i,j is the same 
for any i, j g C ( Q l) ). 

Let us consider, for example, the case in which we have 
n disjoint communities of size N®, I = 1,...,JV such 
that N — Yli^ ■ Let us suppose that each commu- 
nity (Co jTq^) consists in a homogeneous random graph 

with average connectivity Cq < 1 (we want to consider 
only situations in which the set (Co, To) is not already a 
percolating cluster). From Eq. (|77j) we have simply 



JO 



Xo 



= 5. 



h3 



1-c 



(') 



.(0 

-0 ' 



I = 1, 



.,71, 



(106) 



from which we get the following total correlator (Eq. 
(|102[) with the choice p — 0) which depends only on the 
community index I: 



Xo )d -Xo ; i = H ~^~7jTj i^C l) , l = l,...,n 



(0 



1-<S 



(107) 



det(c) = 1, 



(105) 



which constitutes a clean generalization of the well known 
percolation threshold c = 1 of the case n = 1 correspond- 
ing to the Erdos-Renyi random graph 15]. However, Eq. 
(|104p is a single equation in the n x n unknown matrix 
elements of c, c"> m \ therefore there are infinite solutions 
for n > 1. Given the matrix xo, now, the analogous op- 
timization problem that we have defined before amounts 
to look for the matrix c that gives the maximum value of 
the largest eigenvalue of the matrix xo 1 c under the con- 
straint that the total cost is fixed: J2i m c^' m V n = c 0- 



Taking into account that the n communities of (Co, To) 
do not interact (there is no inter-link) by plugging Eq. 
(HOBf in Eq. (Jjp we have 



1=1 OL 



(') 



1-c, 



(0 



(108) 
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where a {l) d = N m /N. For N large Eq. (fT08|) becomes 



„(0 



1=1 a 



(0 



1-c, 



(0 



which, in turn, can be rewritten in terms of the Xo as 
F 0o ({p i }) = cNY / Pi 



+°±^r\ Eft. - 



(110) 



From Eq. (|110p we see that the heuristic solution (|101[) 
provides manifestly the global maximum for i*oo({pi}) 
only when all the communities have the same size a™ = 
1/n, otherwise the exact global maximum will be pro- 
vided by the labelings of the piS such that 



Pi > P], 



_(0 
Xo 



a 



(0 



i ~(m) 

1 > Xo 



VieC$\vjeC m) - 



(ill) 



Of course, due to the homogeneity of the communities, 
we have at least as many equivalent global maximum as 

n"=i Nil) ! ( if the ratios \Xo } - 1] are not all different 
the number of equivalent global maximum is greater). 

In the above example we had three important simpli- 
fications: (i) the communities were not interacting; (ii) 
each community was homogeneous; (Hi) we were able to 
calculate analytically the terms X0;i,i- I n t ne most gen- 
eral case none of the above conditions is satisfied. In par- 
ticular, when condition (Hi) is not satisfied, to calculate 

the total correlator y$ of the Z-th community, defined as 



-(0 def 
Xo = 



E 



Xo 



hi ■ 



z = i, 



. n, 



(112) 



we have to resort to a Monte Carlo strategy, either by 
an Ising model at low temperature (simulated annealing) 
(in view of Eq. ([M)) ) or by a direct graph analysis (in 
view of Eq. (llOOp V However, if conditions (i) and (ii) 
are satisfied, Eq. (|110[) is still exact and the global maxi- 
mum will be given by Eq. (II 1 1 p with the total correlator 
defined by Eq. (|112[) . It is interesting to note that if, 
as usually happens, the communities are hierarchically 
organized in nested communities at deeper and deeper 
levels, and conditions (i) and (ii) still satisfied at each 
level of the hierarchy, we can iterate the above procedure 
through a natural generalization of Eqs. (|110l) - (|112j) at 
each level of the hierarchy. For example, if the communi- 
ties are organized into two levels, i.e., (Co, To) is splitted 



in 7i i communities l\ = 1, . . . , m, each one in turn split- 
ted in njj communities as 



(£o,r ) =u^ =1 (4 ,l) ,r^) 

=ur 1 i =1 u^ 1 (4 l, ' 2) ; 4 l,i2) ). (us) 

it is then easy to see that Eq. (jllOl) generalizes to 
F^fa}) = cNY,Pi 

i 

( 



ni ™<i ~(l u l 2 ) 1 

•'•EE 



ii=l U=l 



E 



(114) 



which has a global maximum in correspondence of the 
following labeling, natural generalization of Eq. (| 11 1[) : 



AhM) _ -i ~(mi,m 2 ) _ -, 

Pi > Pjj *o ^ ; ; > Xo 



v<G4 ,1 ' l3) .vjG4 mi ' ma) . 



Jmi,m 2 ) ' 



(115) 



where now the total correlators Xo' and the coeffi- 
cients aC 1 '' 2 ) arc defined as 



~(h,h) def 
Xo 



E X0;i,j, 



(116) 



(117) 



with A^)^^ 1 '^!- 

Whatever be the graph (£ ,r ), the task to compute 
via a Monte Carlo method the total correlators usually 
requires a computational cost which grows only polyno- 
mially in the system size N. A serious problem comes 
however when conditions (i) or (ii) are not satisfied. In 
this case in fact the heuristic solution (|lllj) (or its gen- 
eralization to the hierarchical case) in general will not 
provide the global maximum for Foo({pi}). As an in- 
termediate situation it may happen that condition (i) is 
not exactly satisfied, but the interaction among different 
communities is weak so that the heuristic solution (|111[) 
(or its generalizations), via the evaluation and compari- 
son of the total correlators, is still a good starting point 
for the numerical search of the exact global maximum of 
Foa({Pi}), especially when also condition (ii) is almost 
satisfied. However, when the communities are well con- 
nected each other, or there is no community structure at 
all, -Foo({Pi}) m general presents an exponential number 
of local maximum, and in fact the computational com- 
plexity of the search for the global maximum of F^ ({pi}) 
becomes equivalent to the Traveling Salesman Problem, 
which is an NP-hard problem [4l|. In this case, in the 
graph (£ ,r ) there is an high degree of frustration and 
the heuristic ansatz (I101[) might be very far, not only 
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from the exact global solution, but in general also from 
the local solutions. We conclude however stressing that, 
despite this worst case scenario for the most general op- 
timization problem, in which one is forced to check for 
almost all the possible N\ labelings of the pi's, the opti- 
mization of Foo^pi}) remains still exponentially advan- 
tageous with respect to a direct inspection (in which c 
is supposed to be given) of all the possible graphs that 
one can build up by adding L = cN/2 long-range links 
over the graph (Cq,T ). In fact, given c, if we evaluate 
the number of ways Af c to lie L = cN/2 long-range links 
among N nodes, for c finite and N large we get 



exp 



N(N-l) 



cN 
2 

N(N- 1) 



(118) 



(| - l) JVlog(JV) 



Traveling Salesman Problem, nevertheless, the use of the 
formula is still exponentially convenient with respect to a 
direct inspection of the network. We think that, at least 
in the absence of load-congestion, our algorithm can find 
important real-world applications. 



Acknowledgments 

This work was supported by PTDC/FIS/108476/2008, 
PTDC/MAT/114515/2009 and SOCIALNETS. We 
thank S. N. Dorogovtsev for useful discussions. 



Appendix A: Bounding A/jv 



By using, as in [2l|, the approximation fcj/ kj ~ Pi, 
where fcj is the average degree of the vertex i, from Eq. 
(151) we have 



VI. CONCLUSIONS 

In this paper we have considered in detail, and in a 
more general framework, the heterogeneous small-world 
model which was briefly presented in the Letter [22j , pro- 
viding now all the complete proofs and new applications. 
By using an effective field theory we prove in particular 
that the critical behavior is never affected by the presence 
of short loops (see Table I). We then apply the general 
result to the study of percolation, correlation functions 
and network design. 

By studying the percolation we have shown, by con- 
sidering several analytically solvable examples, the role 
played by short loops in modifying the percolation 
threshold in networks. In particular, we have seen how 
the presence of short loops increases the percolation point 
[seeEq. (|S8])]. 

By studying the correlation functions, we have found 
that for a scale-free network, with or without short loops, 
finite size effects can be very strong [see Table II and 
Eqs. (|36| and (j?8"]) ]. Moreover, when 7, the exponent of 
the degree distribution, is as small as 7 < 3, the finite 
size effects become persistent even in the thermodynamic 
limit, with the strongest correlations being those among 
hubs. We stress that this is true even in the paramag- 
netic region and with or without short-range couplings, 
contradicting then the common opinion that correlations 
in purely mean-field models always disappear in the ther- 
modynamic limit p8l |. 

Finally, we have seen that the formula for the per- 
colation threshold suggests a natural way to optimize 
the communication features among communities even if 
they interact. We propose and discuss the efficiency of 
a heuristic solution [see Eqs. (|L0L|) - (IL03[) ] at several lev- 
els: isolated and homogeneous communities, weakly in- 
teracting communities, and ill defined communities. The 
worst case scenario in which there is no evident commu- 
nity structure, is an NP-hard problem equivalent to the 



which can be rewritten as 



~Nc 



- 1 



(Al) 



^N = ^Y, v ( k> ir\ k *)p^> ,A2) 



where p(ki) is the probability that vertex i has degree fej, 

and V {k > ^\ki^ is the conditional probability that, 

given that the vertex i has degree fcj , a randomly chosen 
vertex different from i has degree greater than Nc/ki- 
Due to the weak degree-degree correlation of the network, 

from V (k > ^ V (k > ff), and from Eq. (lA"2l 

we have 



■A/W < 



2 /j. dk P^ 



(A3) 



where k\,[{N) is the maximum allowed degree in the net- 
work. Of course it always < N. By using now 
the hypothesis that for k large p(k) ~ fc -7 , we arrive at 



rk M (N) 

< — / dkp(k)k~<- 1 (Nc) 1 -~< < 



2(7-1) Ji 

AT2-7 c l-7 

< 



log(JV), 



2( 7 -l) 

where we have used fcjvf (iV) < N. 



(A4) 



Appendix B: Derivation of the self-consistent 
equation 

In this Appendix we derive Eqs. (|22H26p . Sometimes 
to indicate a link we will use the symbol or more 
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shortly ij. Let us rewrite explicitly the adimensional 
Hamiltonian as follows 

/3H cac = - } (co.ijPJ .ij +c i jPJ i j)<r i o-j 
(j,i)er 

Cij/3Jij<Ticrj ~ (3h o-j{Bl) 
i<j, (i,j)<£r i 

In [H} we have introduced the following mapping. Given 
a lattice C with N = \C\ spins, and a generic quenched 
Hamiltonian Hj 

i<j i 

where the couplings {Jij} are distributed according to a 
given distribution {djlij}, let us consider the two follow- 
ing related non random Ising Hamiltonians with labels 
£ =F and £ =SG 

= -^jg^.-/^^, (B3) 

where the effective couplings pjy are given by 

tanh^f) = /d^(4)tanh iE (/34), (B4) 



/3J^- are at least 0(l/./V) on the fully connected graph 
(also called complete graph) (£,P/) then, in the para- 
magnetic (P) region, the pure model with the effective 
Hamiltonian , with £ =F or SG, gives rise to the 
same non trivial part of the free energy (see Appendix 
C) and the same correlation functions of the original 
Hamiltonian Hj, the stable phase between F and SG 
being determined by the minimum of the corresponding 
associated free energies 

j(F) Qr y(SG)^ Thig in partic _ 

ular gives us the exact critical surfaces paramagnetic- 
ferro (P-F) and paramagnetic spin-glass (P-SG) and, by 
a simple analytic continuation, approximations also out 
of the P region which allow us to get the critical behav- 
ior. The above condition on the effective couplings can 
be expressed as an infinite dimensionality of the model. 
Let us apply the mapping to our small-world scale-free 
case. The quenched Hamiltonian (|B1[) can be rewritten 
in the form (IB2I) where 



ij ~ \ djJij, £ r . [ ! 



with l s = 1,2 for £ =F or £ =SG, respectively. In [42| 
we have shown that, if the effective couplings f}J>. or 



By applying Eq. (|B4[) to our case with the independent 
measures po(co-i,j) and Pij(cij) defined by Eqs. ([!]) and 
([5]) and with rf^oij = <^Mo an d dfiij — dfj, being two ar- 
bitrary independent measures, we arrive at the following 
effective couplings 



J 



tanh(/3jf } ) 



{l-p)j cMJo)tanh' s (/3Jo) 
/fe,p,)/^(J)tanh fe (/3J), 



r 



o(jf), (i,j)er , 



(B6) 



In particular, for large N, in the region J where the 
factorization ([6]) f{pi,pj) = cNptpj takes place, from 
Eqs. (|B6|) we get 



;(E) = f tanh (i,j)eT , 

« \civ^ s ), (z,j)^r , 



(B7) 



where i[> E) and t^~> are defined as in Eqs. pg ]l -([2g ]l . 
We have to evaluate the following partition function 



where 



(*,i)er 



By using Eq. (|B7[) we rewrite ,2^ s ) as 



Z P0 = E 

to) 



xe 



^Ei <7<+0(JV 3_ ' T log(iV)) 



(B8) 



where 0{N a \og(N)) stands for the contributions coming 
from the links (i,j) for which the factorization in the 
second line of Eq. (|B7[) is not true and we have used 
Eq. (|A4I) . For N large but finite, the corrective term 
0{N a log(iV)) can be always neglected, the error per spin 
being of order C^iV 1-7 log(iV)). 

In the following we will suppose that t^' is positive. 
The derivation for negative differs from the other 
derivation just for a rotation of w/2 in the complex m- 
plane, and leads to the same result one can obtain by 
analytically continue the equations derived for > 
to the region < 0. By using the Gaussian transfer- 
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mation we can rewrite as 

xe Ei(t <S) cA r mp 1 +/3/ l ), 



where cat is a normalization constant 



dm e 2 



it (E> cATm 2 



(B9) 



CAT 



t^cN 



2tt 



and, in the exponent of Eq. (IB9|) . we have again neglected 
terms of order O(l). For finite AT we can exchange the 
integral and the sum over the tr's. By using the defini- 
tion of the pure model with Hamiltonian Hq, Eq. ©, 
whose free energy density, for a given coupling /3Jo and 
for an arbitrary (inhomogeneous) external field is 
indicated by /o(/3Jq, {Phi}), we arrive at 



dm e 



-JVL< E) (m) 



(BIO) 



1) 



where we have introduced the function 
V ; 2 

+ Pfo (pj^\{t^cNm P j + ph}) (Bl 

By using d phi Npf (pJ , {/3hj}) = -m oi (pJ ,{phj}), 
and df) h] ]m {(3J ,{(3hi}) = xo-,i,j(PJo,{Phi}), where 

def 

Xo-,i,j = (fiCTj-)o - (o-j>o(o-j>o, we get 
i'( E )(m) = i (s) c[m 

- 5] moi ^4 S \{t^cNm Pj + /%}) Pl 



(B12) 



L"W(m)=tW c \l-tWcNx 



(.B13) 



If the integral in Eq. (|B10I) converges for any N, by per- 
forming saddle point integration we see that the saddle 
point is solution of the equation 



Til 



J2 TO « (pj^A^cNm^Pj + /%}) Pl {BU) 



so that, if the stability condition 

t^cNj^XOiid (pJ^\{t^ ) cNm^pi+Ph})p i p j < 1, 



is satisfied, in the thermodynamic limit we arrive at the 
following expression for the free energy density of 
the related Ising model 



r t (E- 



—cm 2 + (3f (pj^\{t^cNm Pj + ph} 



(B15) 



Similarly, in the thermodynamic limit [49(, any correla- 
tion function of the related Ising model is given in 
terms of the correlation function Co of the pure model 
by the following relation 



= C (pJ^^t^cNmpj + f3h} 



.(B16) 



The saddle point solution represents the weighted 
magnetization (f2T)f of the related Ising model, as can be 
checked directly by deriving Eq. (|B15|) with respect to 
ph and by using Eq. (|B14|) . For E =SG Eq. (J29J) remains 
an ansatz. 

If the saddle point equation (|B14[) has more stable so- 
lutions, the "true" free energy and the "true" observable 
of the related Ising model will be given by Eqs. (|B15p 
and (|B16|) . respectively, calculated at the saddle point 
solution which minimizes Eq. (TBT51) itself and that we 
will indicate with 

Let us call P c0 the inverse critical temperature of the 

pure model with coupling Jq and zero external field, 

possibly with /3^ = oo if no phase transition exists in 
the pure model. As stressed in Sec. IIIB, for the pure 
model we use the expression "critical temperature" for 
any temperature where the magnetization mo at zero ex- 
ternal field passes from to a non zero value, continu- 
ously or not. Note that, as a consequence, if Jq < 0, 
we have formally p cQ — oo, independently from the fact 



that some antiferromagnetic order may be not zero in the 
pure model. Let us start to make the obvious observation 
that a necessary condition for the related Ising model to 
have a phase transition at h = and for a finite temper- 
ature, is the existence of some paramagnetic region p( s ) 
where m/ s ) = 0. By expanding for small m( E ' = we see 
from the saddle point equation (jB14l) that, for h = 0, a 
necessary condition for m < - E ' = to be a solution is that 
be P < P^ 1 for any P in P^ 2 * 1 . In a few lines we will see 
however that the inequality must be strict if P cQ is finite, 
which in particular excludes the case Jq < (for which 
the inequality to be proved is trivial). Let us suppose 
for the moment that be pc < PcO ■ For p < p y cQ ' and 
h = 0, the saddle point equation (jB14[) has always the 
trivial solution rrS^ = which, according to the stability 
condition, is also a stable solution if 

t^cN^Xo^j (pj^\{Q}) PlPj < 1. (B17) 



The solution = starts to be unstable when 

t^cNj2xo;i,j {pj^\{Q})piPj = 1. (B18) 



Eq. (|B18|) , together with the constrain p^ < P^' , gives 

the critical temperature of the related Ising model pc • 
In the region of temperatures where Eq. (jB17|) is vio- 
lated, Eq. (jB14[) gives two symmetrical stable solutions 
±m (s) ^ 0. Furthermore, from Eqs. (|B14|) and (|B18|1 we 
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see also that, if we make the very plausible assumption 
that the number of vertices i for which Pi > 1 /N grows 
with N as aN (see Eq. (fTT|) ) , with a asymptotically con- 
stant for N large, due to the fact that the pure model has 



a divergent susceptibility at , the case fi)^' — /3^' is 
impossible unless be — 0. We have therefore proved 
that P [ P < ^o 3 . Note that for J (S) > and j3 < 
Eq. (|B17|) is violated only for (3 > (3^\ whereas for 
J (S) < Eq. (|Bl7|) in general may be violated also in 
finite regions of the j3 axis. 



Appendix C: Free energy 

Concerning the full expression of the free energy den- 
sity, we proceed as follows. If ip^ is the high temper- 
ature part of the free energy density of the related 
Ising model that we have solved in Appendix B, then 



-pf^= lim- T log fcosh(/3jf >) 
(<,j)er 

lim — log [cosh ( ct^ NpiPj 
/■->oo TV ^— ' L V 



+ 



JV- 



-flog [2cosh(/3/i)] + </? (S) - 



(CI) 



On the other hand, the free energy of the model obeys 
-j8/ = log [2 cosh(/3/i)] + ^ 

+ J im 4 Z /^Mo(Jo)(l-p)log[cosh(/3Jo)] 

TV— >oo iv * — ' J 



(»,j')er ' 



+ Jini^ i ^ /" d/i( J) log [cosh (/3 J)] cJVp iPj . (C2) 

Therefore, by using the mapping </? = cp^' /Is, and 
= L^\m^), where L< s ) is given by Eq. (jBTTI) . 
and m^ s ' is the solution of the self-consistent Eq. (1221) . 
and by choosing £ according to which is minimum be- 
tween L (F) (m (F) ) and L (SG) (m (SG) ), comparing Eq. ([CTj) 
with Eq. (|C2[) we get the total free energy /?/. It is clear 
however (as already anticipated) that the only part of the 
free energy which depends on the order parameter and 
that is therefore responsible for the critical behavior of 
the system and the correlation functions is <p. The rest 
of the free energy is important only to calculate the total 
specific heat. 



Appendix D: Proof of Eq. (f73)) 

Let us start to express the partition function of the 
pure model in the high temperature expansion. In gen- 
eral, for the partition function Z of an Ising model having 
a set of links b € T taking the couplings { J&} and in the 



presence of arbitrary external fields {hi}, we have 



N 



Z({Jb};{hi}) = Y[cosh(/3J b )Y[cosh(phi 



ber i=i 

x II t 1 + a *h a 3* tanh s J b)] 
{a-i} ber 



N 



X 



JJll + o-itanhOSfc)], (Dl) 



where i b and % are the two sites linked by the link b. It 
is not difficult to recognize that Z can be rewritten as a 
sum over paths as follows 



JY 



Z({J b };{hi}) = Yl cosh Jb) IJ cosh (0hi) 



ber i=i 

x En**n*«' 

■yeTbej ied~t 



(D2) 



where: T is the set of all possible multi-paths on T, in- 
cluding then all the possible combinations of closed and 
open paths; stands for the subset of vertices which 
belong to the border of the multipath 7 (if it has at least 
one open path component); and we have introduced the 
short notations % = tanh(/3Jf,) and t, = tanh(/3/ij). Note 
that the cardinality \d*y\ is always an even number. We 
want now to calculate the average magnetization (<Ji). 
By derivating Eq. (|D2|) with respect to j3hi we get 



E 7 er<'> rib£ 7 ^ n 



je&y\i *J 



S 7 gT IIbe 7 tb Ylje 



(D3) 



where T^' stands for the subset of T having at least one 
open path component which passes through the vertex i. 
As done in Sec. HID, we cannot expand the terms for 
small hi, but we can neglect (U) 2 terms. In other words, 
we expand (crj) at the least non zero order - not in the 
{hj}, and nor in the {tb} - but in the {tj}. Within this 
approximation Eq. ()D3|) becomes 



(<ji) = ti + 



where now T~i stands for the subset of T having one and 
only one open path component which passes through the 
vertex i, j^' is second end of this path component pass- 
ing through i, and C stands for the set of all the closed 
multi-paths on V. Notice that, as anticipated, this lat- 
ter definition makes the calculation exact with respect to 
the presence of loops of any length and taking any cou- 
pling. Similarly, for the connected correlation function, 
by deriving once more with respect to /3hj we get 



S 7 ec IIbe 7 ^ b 



0({t 2 }), (D4) 



Xij 



X) 7E 7^W) IIbe 7 tb 
S 7 ec Ilbe 7 



tb 



Odt 2 ,}), (D5) 



22 



where J^ 1 '^ stands for the subset of T having one and 
only one open path component which passes through 
both the vertices i and j. From Eq. ()D6|) one can obtain 



the susceptibility \ up to 0({^}) terms by summing over 
i and j and dividing by N. In particular, for a regular 
lattice we have 



X 



S 7S 7- i < i o) llbe 7 *b 
E 7 GC IIbe 7 ^ b 



0{{t]}), (D6) 



where iq is an arbitrary vertex chosen as reference. If 
we now, for a regular lattice, plug in Eq. (|D4[) in the 
self-consistent equation (|22|) . use the definition (|63| and 
the property (|58|> . we get the bound 



m < g(m) + 



S 7 gc Ilbe 7 *6 



+ 0({t?})£D7) 



which, by using (|D6|) . leads immediately to Eq. (|73l) . 



Appendix E: Derivation of Eq. (|75[) 



Eqs. (|B10|) - (|B14[) are already in a form able to 
take into account the presence of an arbitrary inho- 
mogeneous external field, {hj}; in these equations we 
have simply to substitute everywhere in their argu- 
ments {h} with {hj}. Then, by deriving L^>(m) 
with respect to and by using, as in Appendix 

B, d ?hi WoG9Jo,{/9M) = -m 0l (/3J ,{/3^}), and 
dphjimoifiJotiPhi}) = XO;ij{0Jo,{Phi}), and the self- 
consistent equation for the order parameter rrS^ , we get 
immediately 



™<h (Vf \ {tWcNmWpj + /%}) , (El) 



which confirms Eq. (|75l) for the correlation functions of 
order k = 1. Then, by deriving in turn with respect 
to /3hj , and by using 



_ En PnX0;n, 3 (fljf* j {N Pq ct^m^ + fife}) 

1 -rf(=)JVEi, n Xo ;J ,n (p4 S) >{Np q d^)m^) +(3h})piP« 



(E2) 



we reach immediately Eq. ([75 
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